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SYSTEMS AND METHODS FOR IMPROVING SEARCH 

QUALITY 

BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

[0001] The present invention relates generally to information search and retrieval 
More specifically, systems and methods are disclosed for improving search quality. 

2. Description of Related Art 
10 [0002] In an information retrieval system, a user typically enters a query and receives 
a list of documents that contain the query terms. Documents that do not contain the 
query terms are ignored. Such systems thus place a premium on proper query 
formulation. 

[0003] What is needed are systems and methods for improving queries such that they 
15 are more likely to yield useful search results. 

SUMMARY OF THE INVENTION 
[0004] Systems and methods are disclosed for improving search quality. It should be 
appreciated that the present invention can be implemented in numerous ways, including 
20 as a process, an apparatus, a system, a device, a method, or a computer readable medium 
such as a computer readable storage medium or a computer network wherein program 
instructions are sent over optical or electronic communication lines. Several inventive 
embodiments of the present invention are described below. 
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[0005] In one embodiment, a method may generally include receiving a query 
containing at least one query term, making a determination whether the query includes a 
compound query term, a query term included in a set of inflectional forms, and/or a query 
term included in a set of alternative spellings, and if so, automatically expanding the 
5 query to include an alternative representations of the compound query term, a 
corresponding inflectional forms from the set of inflectional forms and/or a 
corresponding alternative spellings from the set of alternative spellings, searching a 
database using the expanded query, and returning results to a user. 
[0006] In another embodiment, a method may generally include identifying a set of 
10 terms associated with a document, expanding the set of terms by further associating with 
the document one or more alternative spellings, additional inflectional forms of at least 
one term in the set of terms, and/or one or more alternative representations of at least one 
compound term in the set of terms, and indexing the document using the expanded set of 
terms. 

1 5 [0007] In yet another embodiment, a method generally includes searching a first set 
of documents for hyphenated words, searching the first set of documents for non- 
hyphenated words that correspond to the hyphenated words, and generating a set of 
associations between the hyphenated and the corresponding non-hyphenated words. In 
one example, the method may further include receiving a query containing a first query 

20 term from a user, locating the first query term in the set of associations between 
hyphenated and corresponding non-hyphenated words, and expanding the query to 
include a second query term associated with the first query term in the set of associations 
between hyphenated and corresponding non-hyphenated words. 
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[0008] According to yet another embodiment, a computer program package 
embodied on a computer readable medium, the computer program package including 
instructions that, when executed by a processor, cause the processor to perform an action 
such as expanding a query received from a user by including one or more alternative 
5 spellings of at least one query term, expanding the query with one or more alternative 
representations of at least one compound query term, and/or expanding the query with 
one or more inflectional forms of at least one query term. 

[0009] According to a further embodiment, an information retrieval system generally 
includes a document database containing a group of documents and query processing 
10 logic operable to receive a query, expand the query using one or more linguistic 

techniques, and search documents in the document database for information responsive to 
the query. The linguistic techniques may include compound term expansion, inflection 
set expansion, and/or orthographic expansion. 

[0010] These and other features and advantages of the present invention will be 
15 presented in more detail in the following detailed description and the accompanying 
figures which illustrate by way of example the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] The present invention will be readily understood by the following detailed 
20 description in conjunction with the accompanying drawings, wherein like reference 
numerals designate like structural elements. 
[0012] FIG. 1 is a diagram of an information retrieval system. 
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[0013] FIG. 2 is a diagram of an illustrative computing device for practicing 
embodiments of the present invention. 

[0014] FIG. 3 illustrates a set of documents upon which a search can be performed. 
[0015] FIG. 4 illustrates an index of the documents shown in FIG. 3. 
5 [0016] FIG. 5 is a flowchart of a method for searching a group of documents such as 
those shown in FIG. 3. 

[0017] FIG. 6A illustrates a method for generating a list of compound words. 
[0018] FIG. 6B is a flowchart of a method for searching a group of documents using 
a list of compound words. 
10 [0019] FIG. 7A illustrates a method for generating inflection sets for a group of 
words. 

[0020] FIG. 7B is a flowchart of a method for searching a group of documents using 
inflectional information. 

[0021] FIG. 8 is a flowchart of a method for searching a group of documents using 
1 5 orthographic information. 

[0022] FIG. 9 is a flowchart of a method for searching a group of documents using 

one or more linguistic techniques to expand the search query. 

[0023] FIG. 10 is an expanded index of the documents shown in FIG. 3. 

[0024] FIG. 11 is a flowchart of a method for searching a group of documents using 
20 an index such as that shown in FIG. 10. 
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DESCRIPTION OF SPECIFIC EMBODIMENTS 



[0025] Systems and methods are disclosed for improving search quality. The 
following description is presented to enable any person skilled in the art to make and use 
the invention. Descriptions of specific embodiments and applications are provided only 
5 as examples and various modifications will be readily apparent to those skilled in the art. 
For instance, while several examples are provided in the context of a German language 
search engine, it will be appreciated that the general principles described herein may be 
applied to other languages, embodiments, and applications without departing from the 
spirit and scope of the invention. Similarly, although many of the examples presented 

10 below are described using Internet web pages as the documents to be searched, it is to be 
understood that offline documents, e.g., books, newspapers, magazines, or other paper 
documents that have been scanned into electronic form, may also be searched. Thus, the 
present invention is to be accorded the widest scope, encompassing numerous 
alternatives, modifications, and equivalents consistent with the principles and features 

1 5 disclosed herein. For purpose of clarity, details relating to technical material that is 

known in the fields related to the invention have not been described in detail so as not to 
unnecessarily obscure the present invention. 

[0026] In an information retrieval system, users typically enter queries via a retrieval 
interface to find responsive documents. The results that are returned are generally 
20 restricted to those documents that match the query in some way. Systems and methods 
are described for augmenting user queries via the application of one or more linguistic 
techniques. In one embodiment, the user's original query is expanded using a database of 
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compound words, inflectional forms, and/or orthographic variations. The expanded 
query is then used to perform a search for responsive documents. 
[0027] FIG. 1 illustrates a system 100 in which methods and apparatus consistent 
with the present invention may be implemented. The system 100 may include multiple 
5 client devices 102 connected to multiple servers 104, 105 via a network 106. Client 
devices 102 may include a browser 1 10 for accepting user input, and for displaying 
information that has been received from other systems 102, 104, 105 over network 106. 
Servers 104, 105 may include a search engine 1 12 for accepting user queries transmitted 
over network 106, searching a database of documents, and returning results to the user. 

1 0 The network 1 06 may comprise a local area network (LAN), a wide area network 
(WAN), a virtual private network (VPN), a telephone network, such as the Public 
Switched Telephone Network (PSTN), an intranet, the Internet, or a combination of 
networks. For the sake of illustration, FIG. 1 shows three client devices 102 and two 
servers 104, 105 connected to a network 106; however, it will be appreciated that in 

15 practice there may be more or less client devices, servers, and/or networks, and that some 
client devices may also perform the functions of a server, and some servers may perform 
the functions of a client. 

[0028] FIG. 2 shows a more detailed example a system 200, such as a client 102 or 
server 104, 105 shown in FIG. 1. In one embodiment, system 200 comprises a 
20 computing device such as a personal computer, laptop, mainframe, personal digital 
assistant, cellular telephone, and/or the like. System 200 will typically include a 
processor 202, memory 204, a user interface 206, an input/output port 207 for accepting 
removable storage media 208, a network interface 210, and a bus 212 for connecting the 
aforementioned elements. 
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[0029] The operation of system 200 will typically be controlled by processor 202 
operating under the guidance of programs stored in memory 204. Memory 204 will 
generally include some combination of computer readable media, such as high-speed 
random-access memory (RAM) and non-volatile memory such as read-only memory 
5 (ROM), a magnetic disk, disk array, and/or tape array. Port 207 may comprise a disk 
drive or memory slot for accepting computer-readable media such as floppy diskettes, 
CD-ROMs, DVDs, memory cards, magnetic tapes, or the like. User interface 206 may, 
for example, comprise a keyboard, mouse, pen, or voice recognition mechanism for 
entering information, and one or more mechanisms such as a display, printer, speaker, 
10 and/or the like for presenting information to a user. Network interface 210 is typically 
operable to provide a connection between system 200 and other systems (and/or networks 
220) via a wired, wireless, optical, and/or other connection. 

[0030] As described in more detail below, system 200 may perform a variety of 
search and retrieval operations. These operations will typically be performed in response 

15 to processor 202 executing software instructions contained on a computer readable 

medium such as memory 204. The software instructions may be read into memory 204 
from another computer-readable medium, such as data storage device 208, or from 
another device via communication interface 210 or I/O port 207. As shown in FIG. 2, 
memory 204 may include a variety of programs or modules for controlling the operation 

20 of system 200 and performing the search and retrieval techniques described in more 

detail below. For example, if system 200 is a server, such as server 105 shown in FIG. 1, 
memory 204 may include a database of documents 229 and a corresponding index. 
Memory 204 may also include a search engine 230 for searching the database 229 using a 
query received from user interface 206 and/or received remotely from a user over 
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network 220. As shown in FIG. 2, memory 204 may also include one or more programs 
for expanding queries and/or documents using the techniques described in more detail 
below, and a user-interface application 232 for operating user interface 206 and/or for 
serving user interface web pages to remote users over network 220. Although FIG. 2 
5 illustrates a system that is primarily software-based, it will be appreciated that in other 
embodiments special-purpose circuitry may be used in place of, or in combination with, 
software instructions to implement processes consistent with the present invention. Thus, 
the present invention is not limited to any specific combination of hardware and software. 
[0031] It should be appreciated that the systems and methods of the present invention 

1 0 can be practiced with devices and/or architectures that lack some of the components 

shown in FIGS. 1 and 2 and/or that have other components that are not shown. Thus, it 
should be appreciated that FIGS. 1 and 2 are provided for purposes of illustration and not 
limitation as to the scope of the invention. For example, it should be appreciated that 
while, for purposes of illustration, system 200 is depicted as a single, general -purpose 

15 computing device such as a personal computer or a network server, in other embodiments 
system 200 could comprise one or more such systems operating together using distributed 
computing techniques. In such embodiments, some or all of the components and 
functionality depicted in FIG. 2 could be spread amongst multiple systems at multiple 
locations and/or operated by multiple parties. For example, query expansion application 

20 23 1 could be implemented on a system that is separate from the system on which 

document database 229 is hosted (e.g., query expansion could, in some embodiments be 
performed on the client, rather than the server). It will be readily apparent that many 
similar variations could be made to the illustrations shown in FIGS. 1 and 2 without 
departing from the principles of the present invention. 
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[0032] As previously indicated, the systems shown in FIGS. 1 and 2 can be used to 
facilitate the retrieval of documents (e.g., web pages) responsive to user queries. FIG. 3 
illustrates a set of German-language documents 302, 304, 306, 308 upon which such a 
search can be performed. For example, documents 302, 304, 306, 308 may be stored on 
5 one or more servers 104, 105 such as those shown in FIG. 1. As shown in FIG. 3, a first 
document 302 contains the words "abendzeitung," "autotelefon," "abirrungen," and 
"betttuch." A second document 304 contains the words "abend-zeitung," "abirrung," 
"autotelephon," and "abisolieren." A third document 306 contains the words "bettuch," 
"bahnwagon," "abisolierten," and "abendzeitung." And a fourth document 308 contains 
10 the words "autotelefon," "bahnwaggon," "abisolierte," and "abirrung." Documents 302, 
304, 306, 308 may also include one or more links (or references) 310 to other documents. 
Although, for the sake of illustration, FIG. 3 shows documents written in German, it will 
be appreciated that the documents could be written in any language or combination of 
languages. 

15 [0033] FIG. 4 illustrates an index 400 based on the documents shown in FIG. 3. The 
first column of the index contains a list of terms, and the second column contains a list of 
documents corresponding to those terms. Some terms, such as "bahnwaggon," only 
correspond to (e.g., appear in) one document (i.e., document 308). Other terms, such as 
"autotelefon," correspond to multiple documents (i.e., documents 302 and 308). 

20 [0034] FIG. 5 illustrates a process 500 by which a search engine, such as search 
engine 1 12 in FIG. 1, might use the index 400 illustrated in FIG. 4 to provide search 
results in response to a query. Search engine 1 12 receives a query (block 502), and uses 
an index, such as index 400, to determine which documents correspond to that query 
(block 504). For example, boolean logic can be used to match the query with the 
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documents, or a term frequency-inverse document frequency (tf-idf) based information 
retrieval score could be used, with the words in the query combined with the words in 
each document. Thus, for example, if the query were "abendzeitung," search engine 1 12 
could use index 400 to determine that "abendzeitung" appears in documents 302 and 306. 
5 These documents, and/or a reference thereto, are then returned to the user (block 506). 
[0035] As seen in the foregoing example, a search may fail to identify documents that 
do not contain the exact query terms. For instance, in the example described in 
connection with FIG. 5, the query "abendzeitung" failed to locate document 304, which 
contains the term "abend-zeitung." 

10 [0036] One way to improve search results is to expand queries to include possible 
variants of the query terms, thereby ensuring that responsive documents that contain 
these variants are not missed. In a preferred embodiment, a variety of linguistic features 
such as compound words, inflections, and orthographic (e.g., spelling) variations are used 
for this purpose. 

15 [0037] Compounds 

[0038] In many languages, certain word pairs can be written separately, written as 
compounds, or hyphenated. For example, in the German language many nouns can be 
concatenated to form longer nominal compounds. In many cases, there is not a standard 
way to write these words (e.g., concatenated, hyphenated, or separated), and thus 

20 different forms may be used in different documents. For example, the term 
"fernsehprogramm" (meaning television program) can be written either as 
"fernsehprogramm" or "fernseh-programm." Thus, a query that uses one form of this 
word, but not the other, may fail to locate responsive documents. 
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[0039] In one embodiment, this problem can be solved or ameliorated by generating a 
list of potential compound words, then using this list to expand queries containing one or 
more compound words from the list. The list of word pairs (or triplets, etc.) can be 
generated in a variety of ways. For example, it could be formed using a dictionary, or by 
5 dynamically searching across a corpus of documents (e.g., Internet web pages) and 
generating a list of compound terms. 

[0040] FIG. 6A shows an example of such a method 600. As shown in FIG. 6A, a 
list of potential word pairs is generated by searching a set of documents for hyphenated 
words (block 602), then searching the documents for the corresponding unhyphenated 

10 version of each word (block 604). A list can then be generated of each word pair (e.g., 
"AB or A-B") that was identified (block 606). In some embodiments, the resulting list 
may then be shortened by, e.g., removing word pairs that occur with a relatively low 
frequency in the set of documents (block 608). For example, an examination could be 
made of the number of times that "AB" appears in the corpus, the number of times that 

1 5 "A-B" appears, and/or the like. It will be appreciated that a number of variations can be 
made to the basic process shown in FIG. 6A. For example, in some embodiments the set 
of documents could also be searched for instances in which "compound" words appear as 
pairs (or triplets, etc.) of separate, unhyphenated words (e.g., "A B"). 
[0041] As shown in FIG. 6B, the resulting list of compound words can then be used 

20 to expand queries that contain one or more of the words on the list. For example, when a 
query is received (block 652), it can be examined to determine if it contains any words in 
the list of word pairs. If the query contains a word that is part of a compound pair, the 
query can be supplemented to include the other part of the pair (block 654). For example, 
the word can be replaced by a disjunction of both forms of the word. For example, "AB" 
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could be replaced by "AB OR A-B"; "A-B" could be replaced by "A-B OR AB"; and so 
forth. Thus, for example, the query "abendzeitung," discussed above in connection with 
FIG. 5, would be expanded to "abendzeitung OR abend-zeitung," and would yield 
documents 302, 304, and 306 (rather than just documents 302 and 306) when compared 
5 with the index. 

[0042] In some embodiments, the list of compound words described above can be 
used to improve search results in other ways as well. For example, documents written in 
formats such as Postscript (PS) or Adobe's Portable Document Format (PDF) often 
include hyphenation to break words at the end of lines. These words may be indexed 
1 0 improperly as hyphenated words. Thus, in one embodiment the list of compound words 
described above can be used at document indexing (or parsing) time. When a hyphenated 
word is encountered, it is compared to the list of compound words, and if it is not located, 
the hyphen can be removed when the word is indexed. 
[0043] Inflections 

1 5 [0044] Similarly, many words have a variety of inflectional forms for expressing 
grammatical relationships such as case, gender, number, person, tense, or mood. 
Examples of English inflections include the addition of "s" to a noun to form a plural, or 
the addition of "ed" to a verb to express the past tense. Other inflections involve 
changing the base word itself, as illustrated by the inflection set "speak," "spoke," and 

20 "spoken." 

[0045] German has a wide variety of inflectional forms as well. For example, 
"abirrung" and "abirrungen" are different inflectional forms of the same root, as are 
"spiel," "spiele," "spielen," "spieles," and "spiels." Thus, a query that uses one 
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inflectional form, but not the others, may fail to identify documents that would be of 
interest to the user who generated the query. 

[0046] Thus, in one embodiment sets of inflectional forms are assembled, and then 
used to expand queries. The inflection sets can be obtained in a variety of ways, such as 
5 by consulting a dictionary or by using an automated tool. For example, if German is the 
query language, the inflection sets could be generated using a language analysis or 
generation tool with a relatively large lexicon of root forms, such as with any suitable 
word form analyzer. 

[0047] As shown in FIG. 7A, in one embodiment a set of inflectional forms can be 
10 created by collecting a set of words from a corpus of documents (e.g., web pages) (block 
702). A word form analyzer can then be applied to this set of words, yielding a set of 
mappings between inflected words and roots (block 704). In some embodiments, the set 
of mappings can be filtered by using only those words that appear in some suitable 
number or percentage of the documents (e.g., those words that appear in at least 100 
15 documents) (block 706). The table can then be inverted, resulting in a set of mappings 
between roots and inflected forms (block 708). 

[0048] FIG, 7B shows a method for performing query expansion using inflection sets 
generated using a method such as that shown in FIG. 7A. As shown in FIG. 7B, if a 
query contains a word that is a member of an inflection set (block 752), the query is 
20 augmented by including the disjunction of all the members in the inflection set (or some 
suitable subset) (block 754). For example, the query "auto spiel" could become "(auto 
OR autos) (spiel OR spiele OR spiel OR spiele OR spielen OR spieles OR spiels)." The 
expanded query is then used to perform a search of the document database (e.g., by 
comparing the search with an index of the database) (block 756), and the results of the 
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search are presented to the user (block 758). Thus, for example, if a user submitted a 
query containing the word "abisolieren," this could be expanded to "abisolieren OR 
abisolierten OR abisolierte," thereby enabling a search of the documents shown in FIG. 3 
to identify documents 306 and 308 in addition to document 304. 
5 [0049] It will be appreciated that a number of variations can be made to the basic 
concepts illustrated in FIG. 7A and 7B. For example, other variants of the root forms of 
the query terms could be included in the expansion, regardless of whether those variants 
were, strictly speaking, inflections of the query terms. As another example, in some 
embodiments the inflection sets used to perform the query expansion could be generated 
10 by consulting a dictionary or other source, rather than applying a word form analyzer in 
the manner described in connection with FIG. 7A. 
[0050] Orthographic Variations 

[0051] Many languages include a number of words that can be spelled in different 
ways. For example, many German words have different spellings due to dialectical 

15 variations and/or the recent spelling reform. Examples of common German spelling 
variations include the interchangeability of "ph" and "P (e.g., "telefon" or "telephon"), 
"6" and "ss" (e.g., "maGe" or "masse"), the interchangeability of various repeat letter 
sequences (e.g., "wagon" or "waggon," "bettuch" or "betttuch," etc.), and the use of 
apostrophes (e.g., "kantsch" or "kant'sch"). 

20 [0052] Thus, in one embodiment a table is created of orthographic variations. This 
can be accomplished, e.g., by consulting a dictionary or other source. For example, many 
of the variations in German spelling can be obtained by examining data relating to the 
German spelling reform (e.g., using any suitable word form analyzer), and/or the like. As 
an example, information on the German spelling reform is provided by Institut fuer 
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Deutsche Sprache (Institute for the German Language) at http://www.ids- 
mannheim.de/org/, a foundation that has published extensive information about the 
German language. As shown in FIG, 8, this table can be used to expand user queries 
(blocks 802-804), which can then be used to search for responsive documents (blocks 
5 806-808). 

[0053] Thus a variety of techniques have been described for improving search results. 
It will be appreciated that these techniques can be applied individually, or in combination 
with each other and/or with other techniques. FIG. 9 illustrates the general process of 
applying linguistic techniques such as those described above to perform searches on an 
10 index or database of documents. As shown in FIG. 9, when a query is received from a 
user (block 902), it is expanded through application of one or more of the techniques 
described above (block 904). The expanded query is then compared to a database index 
to locate responsive documents (block 906), which are then returned or identified to the 
user (block 908). 

15 [0054] It will be appreciated that a variety of changes can be made to the systems and 
methods described above in accordance with embodiments of the present invention. For 
example, the techniques described above can be applied in combination with other 
techniques, such as spelling correction, synonym and/or related-word expansion, 
language translation, spam reduction, and/or the like, to further enhance search results. 

20 As another example, in some embodiments multiple searches could be performed in 
response to a user's query. For example, a search could first be performed using the 
user's original query, followed by one or more searches using expanded or re-written 
versions of that query. The results of these searches could be evaluated (e.g., using 
information regarding the user's preferences and search history), and the results 
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determined to be most likely to be useful could be returned. For example, the highest 
quality results from the original query could be supplemented with results from the 
expanded query if those results were determined to be of higher or comparable quality. 
Alternatively, or in addition, the terms in the expanded query could be weighted 
5 differently. For example, a higher weighting could be assigned to the original query 
terms, and lower weightings could be assigned to the terms added via expansion. 
[0055] In addition, although the examples described above involve expansion of the 
user's query, in other embodiments the document index itself can be expanded instead (or 
in addition). FIG. 10 shows an example of such an expanded index for the documents 

10 shown in FIG. 3. As shown in FIG. 10, the various compound terms, inflection sets, and 
orthographic variations are grouped together in the left-hand column of the index, and the 
documents that contain any term in the group are listed in the right-hand column. As 
shown in FIG. 11, once the expanded index is generated (block 1 102), user queries 
(block 1 104) can be compared directly with the index (block 1 106) without performing 

15 query expansion. Alternatively, some combination of index expansion and query 
expansion could be used. 

[0056] Moreover, while many of the examples provided above have been in the 
context of the German language, it will be appreciated that the techniques that have been 
described are readily applicable to other languages as well. Each language has its own 
20 set of linguistic features that pose problems for search. Thus, to design a search engine- 
for a given language, and/or a general-purpose search engine, an effort can be made to 
identify these problems and to address them. For example, random searches can be 
performed to see what search terms cause problems. The search terms can then be varied 
to see if improvements can be made. User sessions can also be analyzed to find patterns 
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in users 5 searching behavior. For example, users may apply certain transformations to 
compensate for problematic aspects of the language. Once a set of problem areas are 
identified, work can be done to generate solutions. Potential solutions can be tested or 
simulated to determine their effectiveness and the amount of effort needed to implement 
5 them. 

[0057] While the preferred embodiments of the present invention are described and 
illustrated herein, it will be appreciated that they are merely illustrative and that 
modifications can be made to these embodiments without departing from the spirit and 
scope of the invention. Thus, the invention is intended to be defined only in terms of the 
1 0 following claims. 
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